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(54) Apparatus and method for generating skeleton-based dynamic picture images as well as 
medium storing therein program for generation of sudi picture images 



(57) Enabling an animation character object, which 
is pictoriaUy deformed by computer graphics techniques 
to visually represent human t>ody or animal or the like in 
the form of a caricature or model, to offer precise and 
more natural motions at its selected constituent portions 
that have inherently no joints and no bones by giving 
thereto joints and steletons. To this end, apparatus and 
method for generating skeleton-based animation 
images in accordance with the principles of the inven- 
tion include solving means as follows. A face section of 
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a cubic character object is provided with auxiliary skele- 
tons as vertically coupled together. Skeletons are pro- 
vided which extend from respective endpoints of such 
auxiliary skeletons and are coupled defining an 
umbrella shape as a whole. These skeletons are asso- 
ciated with models each consisting of an ensemble of 
polygons for rendering the character defbrmable by 
changing rotation amount of each skeleton. 
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E)escription 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention s 

The present Invention relates to apparatus and 
method for generating dynamic picture images by effec- 
tuating polygon mapping using skeletons which are 
adaptable for use in advanced computer graphics archl- io 
tecture including but not limited to home-use television 
(TV) game machines. The invention also relates to stor- 
age or record media storing therein a software program 
for creation of such movable picture images for visual 
presentation on the screen of an associated display is 
unit. 

2. Description of the Related Art 

Where an attempt Is made to precisely represent 20 
movement or motions of a three-dimensional (3D) 
model structured from polygons, the resulting polygons 
increase In number causing workload of an associative 
central processing unit (CPU) to likewise increase when 
the CPU is designed to calculate endpoint coordinates 25 
on a mere step-by-step bases (vertex difference anima- 
tion scheme), which In turn makes it difficult to move a 
model(s) on a real time basis. Especially, such prior 
known approach is not adaptable for use with TV games 
which are designed to allow more than one model to so 
exhibit various kinds of motions or "actions" in rapd 
response to game player's operations of several types 
of key buttons of his or her game machine. 

In the recent years one scheme has been employed 
which utilizes multi-joint structures for enabling achieve- 3S 
ment of several kinds of actions by use of skeletons cou- 
pling between joint sections. This scheme using such 
multijoint structures will be briefly explained with refer- 
ence to Fig. 26. In Fig. 26. a graphics image object 90 
represents an animation character corresponding to a 40 
model of a human body, which object has a multijoint 
bone structure with a number of joints 91 at certain loca- 
tions identical to those of real human joints, Adjacent 
ones of the joints 91 are coupled together by a corre- 
sponding one of bones 92 as called the "skeletons" In 4S 
the art of conputer graphics. Of those skeletons 92, one 
skeleton 92a coupled at one reference point AO indica- 
tive of a joint 91 con-esponding to the waist of human 
body is treated as a "parent" skeleton which is vectori- 
cally defined with such reference point AO being as an so 
origin. Further, its following skeletons 92 which are 
sequentially coupled from the parent skeleton 92a, 
head, both hands and both legs in this order are vector- 
ically defined in a way such that one of them is defined 
by vector with an endpoint or tip of its upstream side one ss 
being as a reference. A surface of character 90 is three- 
dimensionally represented by a model which consists of 
a predefined number of polygons as defined in a way 



corresponding to respective skeletons 92. Where move- 
ment or motion is given to the nxxiel, sequentially sup- 
ply respective skeletons 92 with vector data (what is 
called the "joint angle" data) in accordance with such 
intended motion causing a polygon associated with 
each skeleton 92 to be displayed while changing its 
position and/or angle in responding to sequential move- 
ment of skeleton 92, which in turn leads to capability of 
visual presentation of the model's moving action. This 
scheme may be similarly applicable to cases of display- 
ing animals as models in such a way that a modelled 
animal image is graphically defined for achievement of 
its motion as a multijoint structure having joints at loca- 
tions corresponding to joints of a real animal. 

The prior art multijoint structure based motion crea- 
tion scheme with graphical joints being given to those 
joint locations of a real bq^ offers mere capability of 
relatively simple actfons of an animation character 
being displayed in operative corporation with angle data 
preset to skeletons, such as tilting and expan- 
sion/shrinking motions of its back, arms and leg- 
s—namely, partial bending and stretching actions— and 
also remains inexpectable to provide more complicated 
actions to such character as presently displayed. 
Accordingly, applying to TV games such animation 
character mere partial bending/stretching motion 
capabilities makes it unable to accomplish a wide vari- 
ety of character's complicated motions or actions as 
demanded by operators or ''game players,** which might 
disadvantageously serve as a serious bar to creation of 
idea-rich and enjoyable TV game software. 

SUMMARY OF THE INVENTION 

It is therefore an object of the present invention to 
provide improved three-dimensional (3D) graphics 
image creation apparatus and method capable of avoid- 
ing the problems faced with the prior art. 

It is another object of the invention to provide 
improved apparatus and method for generating skele- 
ton-based 3D dynamic picture images of animation 
characters as modelled or deformed to represent natu- 
ral creatures including human and animals, capable of 
permitting more natural and precise actions by supply- 
ing joints and skeletons to those constituent portions 
without inherent joints and bones thus enabling devel- 
opment of more interesting idea-rich TV games. 

It is yet another object of the invention to provide a 
recording medium storing therein a software program 
for creation of skeleton-based 3D nKsvable graphics 
images of character objects representative of human 
bodies and animals, capable of permitting more natural 
and smooth actions thereof on a display screen. 

In accordance with an aspect of the present inven- 
tion, apparatus for generating a skeleton-based mova- 
ble picture Image includes a storage device for storing 
therein spatial coordinate data of skeletons as coupled 
together and a model associated with each skeleton. 
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and a calculator unit for sequentially taking skeletons 
out of the storage and for calculating based on such 
data a display position of the model associated with 
each skeleton on a two-dimensional (2D) display 
screen, wherein the storage is specifically an^anged to 5 
store an auxiliary skeleton not relating to the model at 
certain location corresponding to an immediately upper 
stream of the lowest stream of skeleton. 

With such an arrangement, skeletons are set to 
respective models as made up of one or a predefined 10 
number of polygons. Each skeleton defines relative 
position attitude of its corresponding polygon of model: 
when such skeleton is specified, a display state of such 
polygon, i.e.. model, on a 2D display screen is deter- 
mined. Preset data items concerning coordinates and is 
rotation amount as well as length for specifying skele- 
tons are stored in advance or "prestored" and are read 
sequentially, when displaying of a character, with 
respect to a plurality of skeletons in a predetermined 
order of sequence permitting sequential data fetching or 20 
acquisition. And. providing the auxiliary skeleton on a 
halfway point may increase the degree of freedom for 
placing a lowest stream skeleton defining its corre- 
sponding model at a preferable position with respect to 
the shape of the character when setting of the relative 25 
position attitude of this model. Whereby, a setting of the 
relative position attitude of the lowest stream skeleton 
and its corresponding model may be made much easier 
while enabling the mode\ to exhibit any precise and 
smooth motions or actions as desired by system 30 
designers. Further, since the auxiliary skeleton has no 
relevancy to model displaying, software design may be 
done only in view of positional relation with the lowest 
scream skeleton. 

In accordance with another aspect of the present 3S 
invention, apparatus for generating a skeleton-based 
movable picture image includes a storage device for 
storing therein skeletons as provided for defining the rel- 
ative positional attitude of polygons acting as display 
elements of a character object and models each essen- 40 
tiaily consisting of a predefined number of polygons as 
associated with each skeleton, and an arithmetic proc- 
essor responsive to rotation amount data supplied in 
response to an operation unit as one of elements for 
definition of the skeletons, for detenmining by calculation 45 
a display position of a model associated with each skel- 
eton on a 2D display screen, wheran a constituent por- 
tion structured from one or a specified number of 
models is deformable. wherein respective skeletons 
each corresponding to the constituent portion are so 
stored in the storage in a mutual associative manner 
thereby rendering the rotational amount data for move- 
ment of a coH'esponding model successfully readable In 
the time-base direction. 

With such an arrangement, the display position of a ss 
model associated with each skeleton on the 2D display 
screen is calculated based on the rotatbn amount 
which is one element for skeleton definition, thereby 



allowing an animation or cartoon character object con- 
sisting of an ensemble of models to be visually indicated 
on the display screen. A constituent pation consisting 
of one or several models to form part of the character 
remains freely deformable. 

It should be noted that the term "deformation" as 
used herein may refer to a partial change or modifica- 
tion of the shape of certain portions which have inher- 
ently no joints— such as vertical, lateral, or 
simultaneous distortion of cubic objects, waving of long 
hair (capillus, animal's tail), open and close movements 
of upper and lower eyelids, arms' swinging, by way of 
example— rather than bending and stretching actions 
about joints, such as bending of arms. legs, wrist and 
ankles or bending of neck. 

This constituent portion is associated with a plural- 
ity of skeletons while causing rotation amount data 
defining respective skeletons to be set as timebase con- 
tents (pattern data) which may permit relative and coop- 
erative motions of models of this constituent portion. 

In accordance with still aspect of the present inven- 
tion, the constituent portion has a cubic like shape, 
wherein skeletons as contained in sudi cubic portion 
are such that a desired number of ones are provided 
defining an umbrella in shape. With such an anrange- 
ment. the cubic constituent portion offers deformability 
such as transformation to an ellipse. Whereby, the cubic 
constituent portion may be freely transformable exhibit- 
ing vertical or lateral enlargement in deference to the 
character's actions, such as jumping, to thereby enable 
successful reproduction of desired character's actions 
with enhanced naturalness and inaeased approxima- 
tion of real motions. 

In accordance with a further aspect of the present 
invention, the apparatus set forth in claim 3 is arranged 
such that a plurality of skeletons are included within tiie 
cubic portion which skeletons are those of no relevancy 
to polygons as vertically coupled together, wherein 
umbrella-like skeletons are provided and elongated 
from at least two locations of an endpoint or tip of the 
auxiliary skeleton defining an umbrella shape. With 
such an anrangement. In cases where umbrella-like 
skeletons are provided from two or wore locations on 
the upper and lower sides of the auxiliary skeleton, 
more precise and accurate deformation of a cubic 
object may be attainable; for example, it becomes pos- 
sible to allow its upper and lower sides to deform coop- 
eratively and also permit simultaneous deformation of 
them. 

In accordance with a still further aspect of the 
present invention, the constituent portion includes an 
ensemble of image components indicative of long hair 
extending from part of a character object with a plurality 
of skeletons being serially coupled together covering 
from a hair root up to a hair tip. With such an anange- 
ment, long hair is subdivided into a plurality of parts 
along the length thereof with skeletons corresponding 
thereto respectively; accordingly, it becomes possible to 
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cause hairy and/or tail sections wHh no actual joints to 
wave or swing in a more natural fashion. 

In accordance with a yet further aspect of the 
present invention, the constituent portion includes 
image components indicative of both breasts of a char- s 
acter object resembling the upper half body of an aduH 
human female while causing two skeletons extending in 
parallel from the same position to have respective tips 
as coupled to respective skeletons con'esponding to the 
constituent portion. With such an an^angement it is pos- 10 
sible to reproduce the right and left breasts of a charac- 
ter object in a way such that these may wave 
cooperatively— simultaneously or laterally or even alter- 
nately—in responding to actions as performed thereby 

In accordance with a yet further aspect of the 15 
present invention, the constituent portion includes 
image components representative of upper and lower 
eyelids of a character object while causing respective 
skeletons con-esponding to the constituent portion to be 
disposed in parallel to ensure that these corespond 20 
from the same position to the upper and lower eyelids 
respectively. With such an arrangement, it becomes 
possible to permit such object to open or close its eyes 
by causing the upper and lower eyelids to come closer 
or go far from each other at a constituent portion con- 25 
sisting of such upper and lower eyelids. 

In accordance with a yet further aspect of the 
present invention, a method is provided fbr generating a 
skeleton-based dynamic picture image by sequentially 
fetching data of skeletons coupled together in a prede- so 
fined sequence and then calculating based on resultant 
data a display position of a model associated with each 
skeleton on a 2D display screen, the method including 
the steps of placing an auxiliary skeleton with no rele- 
vancy to a model at a specific location on an immedi- 35 
ately upper stream side of the lowest stream of 
skeleton, and successively executing fetch or acquisi- 
tion of data of the lowest stream skeleton after comple- 
tion of fetching of the auxiliary skeleton. 

With such a method, skeletons are defined fbr 4o 
respective models each consisting of one or several pol- 
ygons. Each skeleton defines relative position attitude 
of the individual one of those polygons of a correspond- 
ing model; specifying a skeleton determines a display 
state of such polygon, i.e. model, on the 2D display 45 
screen. Preset data items indicative of coordinates, 
rotation amount and length are prestored allowing upon 
displaying of a character any necessary data items to 
be read sequentially with respect to plural skeletons in a 
predefined order of sequence. And, placing the auxiliary so 
skeleton at an immediately upstream location of the 
lowest stream of skeleton may advantageously serve to 
increase the degree of freedom for providing certain 
skeleton defining its corresponding model at a prefen-ed 
positron in the character's shape during setting of the ss 
relative position attitude of the model. This makes it 
much easier to set the relative position attitude of the 
lowest stream skeleton and its corresponding model 



while at the same time providing the model with any pre- 
cise and more natural motions or actions as desired by 
system designers. Furtiiermore, since the auxiliary 
skeleton remains free from or independent of the model 
displaying procedure, design complexity may be 
reduced due to the fact that any intended design is com- 
pleted only in view of positional relation with the lowest 
stream skeleton while simultaneously enabling fadiita- 
tion of settings thereof. 

In accordance with a yet further aspect of the 
present invention, a metiiod is provided fbr generating a 
skeleton-based movable picture image feonprising the 
steps of providing one or more skeletons for use in 
defining the relative positional attitude of polygons act- 
ing as display elements of a character object, causing 
each skeleton to be associated with a model consisting 
of an ensemble of a predefined number of polygons, 
and calculating based on rotational amount data given 
in response to key/button operations as one element for 
definition of the skeleton tiie display position of a model 
associated with each skeleton on a 2D display screen, 
tiie method further comprising defining as part of tiie 
character object a deformabfe constituent portion con- 
structed from one or a plurality of models, adding time- 
base rotational amount data to each of the skeletons 
corresponding to the constituent portion, and effectuat- 
ing deformation while letting corresponding models be 
associated with each otiier. 

With such a method, tiie display position of a model 
associated with each skeleton on 2D display screen is 
calculated based on the rotation data being as one ele- 
ment d^ining a skeleton, thereby allowing a character 
consisting of a group of models to be displayed on the 
screen. A constituent portion made up of one or several 
models to constitute part of the character remains 
deformable in shape. The term "deformation" is tiie 
same as stated supra. And, this constituent portion is 
associated with plural skeletons allowing them to coop- 
eratively move in deference to timebase rotation amount 
data defining respective skeletons. 

In accordance witfi a yet further aspect of tiie 
present invention, a program is provided for generating 
a skeleton-based movable picture image by sequen- 
tially fetching data of skeletons coupled together in a 
specified order of sequence and then calculating the 
display position of a model associated with each skele- 
ton on a 2D display screen, wherein an auxiliary skele- 
ton with no relevancy to a model is placed at certain 
location in the immediate upper stream of the lowest 
stream of skeleton while causing fetch of the lowest 
stream skeleton to be performed in a way successive to 
fetching of the auxiliary skeleton data. 

With tiiis, placing the auxiliary skeleton at certain 
location on tiie immediate upstream sbe of the lowest 
stream skeleton may increase tiie degree of freedom for 
disposing an intended skeleton of tiie lowest stream 
defining its corresponding model at a desired position in 
tiie character's shape during setting of relative position 
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attitude of the model. Whereby, a setting of the relative 
position attitude of the lowest stream skeleton and its 
con^esponding model may become much easier while 
enabling the model to exhibit any precise motions or 
actions as desired by system designers. Further, since 
the auxiliary skeleton has no relationship with model 
displaying, design may be done by taking account of 
only positional relation with the lowest stream skeleton 
while rendering its settings much easier. 

In accordance with a yet further aspect of the 
present invention, a record earner medium is provided 
which stores therein a program for generation of a skel- 
eton-based dynamic picture image by providing skele- 
tons for use In defining the relative positional attitude of 
one or several polygons which are display elements of a 
character object, causing each skeleton to be associ- 
ated with a model that essentially consists of an ensem- 
ble of predefined number of polygons, and calculating 
based on rotational mount data given In response to key 
operations as one of elements defining the skeletons a 
display position of a model associated with each skele- 
ton on a 2D display screen, the program further com- 
prising defining as part of the character object a 
deformable constituent portion structured from one or a 
plurality of models, adding timebase rotational amount 
data to each of those skeletons corresponding to the 
constituent portion, and allowing corresponding models 
to be given with mutually related movement or motions. 

With this medium, the constituent portion is associ- 
ated with plural skeletons allowing them to move coop- 
eratively in deference to timebase rotation mount data 
defining respective skeletons. 

These and other objects, features and advantages 
of, the invention will be apparent from the following more 
particular description of pretended embodiments of the 
invention, as illustrated in the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig, 1 is a diagram showing a configuration of a 
game system In accordance with one preferred embod- 
iment of the invention. 

Fig. 2 is a functional block diagram showing func- 
tions of a CPU shown in Fig. 1 . 

Fig. 3 is a diagram showing one extracted part of a 
character object which part represents its arm section. 

Fig. 4 is a diagram showing a table that stores data 
indicative of vertex coordinate data of a specified 
number of polygons which may constitute a model 
associated with each skeleton SK. 

Fig. 5A is a data table for explanation of an inter- 
memory top address GET (=F(ADD,PAT)) of a selected 
character pattern; and Fig. 5B Is a diagram showing 
rotation amount data items Rx(a), Ry(P). R2(y) of each 
skeleton SK for causing a frame image indicative of 
every scene through movement to perform a series of 
motions from the first to n-th pattern data as given to 
each polygon. 



Fig. 6 is a diagram showing one exemplary object 
representative of an animation character as a model 
with five skeletons. 

Rg. 7 is a flow diagram showing a procedure of cal- 
5 culation of skeleton coordinates. 

Fig. 8 is a flowchart of a display routine as executed 
by the CPU. 

Rg. 9 is a flowchart showing a subroutine of "model 
displa/' procedure. 
10 Fig. 1 0A is a diagram showing a front view of a first 
exemplary animation character image applicable to the 
invention in a standardized or "neutral" attitude stale: 
and Fig. 10B illustrates a side view of the same. 

Rg. 11 A is a diagram showing a front view of the 
15 Character of Fig. 10A which expands vertically or 
"stands up"; and Fig. 11 B is a side view thereof. 

Rg. 12A is a diagram showing a front view of the 
character of Fig. 10A which shrunk vertically or 
"crouched"; and Fig. 12B is a side view thereof. 
20 Rg. 1 3 is a diagram showing a side view of the first 
&cemplary character as stmctured from an ensemble of 
skeletons and polygons in the neutral state. 

Rg. 14 is a diagram showing a side view of the first 
character structured from an ensemble of skeletons and 
25 polygons in the standup state. 

Rg. 1 5 is a diagram showing a side view of the first 
character consisting of plural skeletons and polygons in 
the crouch state. 

Fig. 16 Is a pictorial representation of the character 
30 skeleton/polygon structure of Fig. 1 2 with ears and legs 
added thereto. 

Rg. 17 is a pictorial representation of tiie character 
skeleton/t30lygon structure of Rg. 13 witii ears and legs 
added thereto. 

35 Rg. 18A shows an animation character as employ- 
able in the invention as the second example which char- 
acter is in the eyelid open state; and Fig. 188 is a side 
view of the same. 

Rg. 19A illustrates the second exemplary character 

40 in tine eyelid close state; and Fig. 19B is a side view of 
the same. 

Rg. 20 deplete a wire-frame graphics Image of a 
head section of tiie second character configured of mul- 
tiple skeletons and polygons in the eyelid open state. 
45 Rg. 21 shows a graphics Image of a head section of 
tiie second character structured from multiple skeletons 
and polygons in tiie eyelid close state. 

Rg. 22A is a front view of one typical on-screen dis- 
play image of the second character witii its eyes looking 
50 left; and Fig. 22B illustrates tiie same image with its 
eyes look upward. 

Rg. 23 is a side view of a graphics image of a tiiird 
exemplary animation character also enrptoyed in tiie 
invention. 

55 Fig. 24 depicts a graphics image of the upper half 
body section of the third character of Rg. 23 including 
its hair made up of multiple skeletons and polygons. 
Rgs. 25A and 25B illustrate graphics images repre- 
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sentative of the upper half body of a fourth exemplary 
female character further usable in the invention as con- 
figured of multiple skeletons and polygons, wherein Fig. 
25A shows its side view whereas Fig. 25B is a front view 
thereof. 

Fig. 26 is a pictorial representation of a graphics 
image for explanation of a scheme for utilizing a multi- 
joint structure to achieve intended motions by use of 
skeletons connecting between joints thereof. 

DETAILED DESCRIPTION OF PREFERRED EMBOD- 
IMENT 

Fig. 1 is a diagram showing a configuration of one 
typical television (TV) game system in accordance with 
one preferred embodiment of the instant invention. 

The game system shown in Fig. 1 includes a game 
machine main body and an associative recording or 
storage medium 30 prestoring therein software pro- 
grams and data. The game machine main body 
includes a CPU 1 , and a bus 2 connected to the CPU 2 
which bus has address, data and control bus lines. The 
game machine also includes a graphics data generation 
processor 3, interface circuit 4, main memory 5, read- 
only memory (ROM) 6, expansion processing circuit 7, 
parallel port 8, serial port 9, graphics drawing processor 
10 with buffer 11, audio processor 13 with buffer 14. 
decoder 1 7 with buffer 1 8. interface circuit 20 and mem- 
ory 21, these conponents being interconnected with 
the bus 2 as shown in Fig. 1 . Further, a TV monitor unit 
12 is connected to drawing processor 1 0; a loudspeaker 
16 is connected to audio processor 13 via an amplifier 
circuit 15; a storage medium driver 19 is connected to 
decoder 17; and, a memory 21 and controller 22 are 
connected to interface circuit 20. 

The game system will be different in configuration 
depending on its practical applications. More specifi- 
cally, in cases where the game system is designed as a 
home-use machine, the TV monitor (referred to as 
"monitor" hereinafter) 12 and loudspeaker 16 will be 
separated from the game machine main body. Alterna- 
tively, where this system is designed as office-use one. 
the parts or components shown in Fig. 1 are assembled 
together in a single integral housing structure. Still alter- 
natively, the game system is designed for use in digital 
communications systems with personal computers 
(PCs) and workstations being as key terminals, the 
monitor 12 may correspond to a PC display unit; the 
drawing processor 10, audio processor 13 and expan- 
sion circuit 7 con^espond to part of software program 
data stored in storage 30 or alternatively hardware on 
extension boards as built in computer expansion slots, 
respectively; and, the interface circuit 4, parallel port 8. 
serial port 9 and interlace circuit 20 correspond to the 
hardware on expansion boards in computer expansion 
slots. The buffers 1 1 , 14 and 1 8 correspond to the main 
memory 5 or respective areas of an expansion memory 
(not shown). The following description assumes that the 



game system is designed as a home-use product, by 
way of example. 

Respective elements shown in Fig. 1 will next be 
explained. 

5 The graphics data generation circuit 3 functions as 
a coprocessor of the CPU 1. More specif toally, this 
graphics data generator 3 performs by parallel process- 
ing architecture several kinds of arithmetic processing 
operations including but not limited. to coordinate con- 

10 version, light source calculation, and fixed point-format- 
ted nnatrix or vector computation. Main processing of 
the graphics data generator 3 may involve calculating 
on-screen addresses of an image being processed 
based on coordinate data of each endpoint or vertex on 

75 a 2D or 3D surface of image data and rotation amount 
data as supplied from CPU 1. returning resultant 
address data to CPU 1. and calculating Image lumi- 
nance or intensity in accordance with the distance from 
a virtually defined light source. 

20 The Interface circuit 4 is operable to provide inter- 
face functions for associated peripheral devices, typi- 
cally a pointing device such as a mouse, track-ball or 
the like. The ROM 6 is for use in storing therein program 
data as the operating system (OS) for the game system. 

25 For PCs. this may be equivalent to the basic input/out- 
put system (BIOS). 

The expansion circuit 7 operates to effectuate 
intended expansion processing with respect to com- 
pressed graphics images as digitally compressed by 

30 intracoding techniques satisfying the moving pictures 
experts group (MPEG) standards for dynamic picture 
images or joint photographic experts group (JPEG) 
standards. Such expansion processing may be decod- 
ing (typically, decoding of data as encoded by variable 

35 length code or "VLC architecture), inverse quantiza- 
tion. Inverse discrete cosine transformation (IDCT), 
intraimage modulation or others. 

The drawing processor 10 is for executing drawffig 
processing with respect to buffer 1 1 leased on drawing 

40 commands as issued from CPU 1 . 

Buffer 1 1 has therein a display area and non-dis- 
play area. The display area is for use in temporarily stor- 
ing data of Images being displayed on the screen of 
monitor 12. In this embodiment the nondisplay area is 

45 used for storage of specific data items including but not 
limited to model data defining polygons, movement data 
causing models to move, pattem data indicative of 
respective motions or "actions," texture data, and color 
palette data. The texture data may here be 2D image 

so data. The color palette data may be for designation or 
assignment of colors of texture data. These data Items 
are prestored in nondisplay area of buffer 1 1 under con- 
trol of GPU 1 in a way such that all of them are stored at 
a time or, alternatively, are divisionally stored at multiple 

55 instants in conformity with progressive situation of a 
game. 

The drawing commands or instructions may include 
drawing commands for depiction of 3D graphics images 
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using polygons, and commands for depiction of ordinary 
2D images. Tlie term "polygon" may refer to one basic 
surface primitive of 2D images as defined by a closed 
plane figure bounded by multiple straight lines; in this 
embocfiment, triangles or rectangles are employed. 

Those drawing commands for drawing or "depict- 
ing" intended 3D images using polygons may involve 
polygon vertex address data stored in display area of 
the buffer 1 1 . texture address data indicative of storage 
locations on buffer 1 1 of texture data to be adhered to 
polygons, color palette address data representative of 
storage locations on buffer 1 1 of color palette data indi- 
cating colors of texture data, and intensity data indica- 
tive of Intensity of texture. 

Of those data items, the polygon vertex address 
data in display area is originated from replacement with 
graphics data generation processor 3's coordinate con- 
version or transformation of the polygon vertex coordi- 
nate data in 3D space from CPU 1 to 2D polygon vertex 
coordinate data based on shift amount data and rotation 
amount data of the display screen per se. The intensity 
data may be determined by graphics data generator 
processor 3 based on the distance between a position 
or location defined by the coordinate-converted polygon 
vertex coordinate data from CPU 1 and a virtually dis- 
posed light source. 

The polygon vertex address data digitally indicates 
an address in the display area of t)uffer 1 1 . The drawing 
processor 10 Is operable to write texture data corre- 
sponding to the range or coverage of display area of 
buffer 1 1 as indicated by three or four polygon vertex 
address data. 

A single object displayable as a graphics image is 
structured from multiple polygons. The CPU 1 causes 
buffer 1 1 to store therein 3D coordinate data of each 
polygon in a way such that the data is related to (or 
associated with) vector data of a con^esponding skele- 
ton as will be described in detail later In this description. 
Where an animation character object image is to be 
moved on the display screen in response to key/button 
operations at the controller 22. in other words, when an 
attempt is nfiade to represent movement of such charac- 
ter per se or to change the position looking at the char- 
acter (viewpoint position), the following processing is 
performed. 

The CPU 1 operates to supply graphics data gener- 
ation processor 3 with 3D coordinate data of each poly- 
gon held in the nondisplay area of buffer 11 and each 
polygon's shift/rotation amount data as obtained from 
the coordinates of the resulting skeleton calculated 
using Equation 1 to be later presented and its rotation 
amount data. Graphics data generation processor 3 is 
responsive to receipt of each polygon's 3D coordinate 
data and each polygon's shift and rotation amount data 
for sequentially calculating or computing respective 
resultant polygons moved and rotated. Of tiiose 3D pol- 
ygon coordinate data items, vertical and horizontal 
directional coordinate data may be passed to the draw- 



ing processor 10 as the address data in the display area 
of buffer 11. i.e. polygon vertex address data. Drawing 
processor 10 is operative to write texture data indicated 
by preassigned texture address data into a triangular or 

5 rectangular display area of buffer 1 1 as defined by tiiree 
or four polygon vertex address data, thereby allowing 
monitor 12 to display thereon an Intended object with 
such texture data adhered to multiple polygons. 

Drawing instructions for instruction of drawing ordi- 

10 nary 2D images may consist of vertex address data, tex- 
ture address data, color palette address data indicative 
of the storage location in buffer 1 1 of color palette data 
representing colors of texture data, and intensity data 
representative of the intensity or luminance of such tex- 

15 ture. Of tiiose data Items, the vertex address data may 
be coordinate data as obtainable by graphics data gen- 
eration processor 3's coordinate transformation from 
the vertex coordinate data on 2D plane as fed from CPU 
1 based on the shift amount data and rotation amount 

20 data from CPU 1 also. Such drawing processing will be 
referred to as Issuing drawing instruction(s)'' hereinaf- 
ter. 

The audio processor 13 Is to write into buffer 14 
application developed pulse code modulation (ADPCM) 

25 data read out of storage 30 causing such ADPCM data 
to be used as a sound source. Audio processor 1 3 then 
operates to read ADPCM data in a w^ synchronized 
with a clock signal of 1 Wlohertz (KHz) frequency. Audio 
processor 13 next forces resultant ADPCM data read 

30 from buffer 14 to be subject to several processings 
including but not limited to pitch conversion, noise addi- 
tion, envelop setting, level setting, and reverve addition. 
Where audio data as read from storage 30 are PCM 
data such as digital audio signals of compact discs 

35 (CDs)— say, "CD-DAs"— or tiie like, such is converted 
by audio processor 13 into ADPCM data. The process- 
ing by program data for such PCM data is directly car- 
ried out witiiin tiie memory space of the main memory 
5. The resulting PCM data as processed wfthin main 

40 memory 5 may tiien be passed to audio processor 13 
for conversion to ADPCM data and tiiereafter supplied 
to loudspeaker 16 for reproduction of audible sound 
and/or voice. 

The storage driver 19 nr^y typically be fixed or 
45 "hard" disk drive, optical disc drive, flexible diskette 
drive, silicon disk drive, cassette medium reader, or 
equivalents tiiereto. The storage medium 30 may be a 
hard disK optical disk or disc, flexible diskette, semicon- 
ductor memory or equivalents tiiereof. Storage driver 1 9 
50 operates to read video, audio and program data out of 
storage 30, which are tiien transfen-ed to the decoder 
17. Decoder 17 is for applying error con-ection code 
(ECC) processing to playback or reproduction data out- 
put from driver 19 generating and issuing enror-cor- 
55 reeled data toward eitiier main memory 5 or audio 
processor 13. 

Tlie memory 21 may consist of a memory device of 
ttie card type and its associative holder. The card-like 
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memory is for retaining a variety of kinds of game 
parameters— 6uch as storing the Interrupted state of a 
game, for example. 

The controller 22 comes with several operation 
keys or buttons including a right trigger button 22R. left 
trigger button 22L. start button 22a, cross key unit oon- 
sisting of an upgoing or "UP" key U. down key D. right 
key R, left key L. cancel button 22c, select button 22d, 
button unit 22e, analog stick 22f. and a determination or 
"enter** key (not shown in Fig. 1) on the rear surface of 
controller 22. 

The cross key 22b and analog stick 22f are for 
allowing an operator a game player to provide CPU 1 
with commands for movement of a character object 
upward, downward, rightward, or leftward on the display 
screen of monitor 12. The upward and downward— i.e. 
vertical-Hiiovement may refer to jumping actions 
(JUMP) whereas rightward and leftward— i.e. horizon- 
tal—movement may be walking (WALK), running 
(RUN1 , RUN2) actions of the character being displayed. 
Respective forms in right and left directions are such 
that each may be distinguishable from the other upon 
simultaneous operations of the right and left trigger but- 
tons 22R and 22L 

The start button 22a is for permitting the game 
player to instruct the CPU 1 startup of a game program 
data as loaded from storage 30. The cancel button 22c 
is for Instructing GPU 1 returning at an immediately prior 
stage with once-determined items cancelled. Select 
button 22d is to allow the game player to give to CPU 1 
several instructions as to his or her selections pertaining 
to the game program data as loaded from storage 30 
Into main memory 5. Button unit 22e is for instructing 
CPU 1 to switch viewpoint within the virtual space of 
such game being visualized. 

Additionally, the right and left trigger buttons 22R, 
22L and enter button on the rear of controller 22 will dif- 
fer in function depending upon kinds of game program 
data loaded from storage 30; by way of example, In 
some fighting games, these are so set as to offer sev- 
eral kinds of attacking actions of a character being dis- 
played. 

An operation of the illustrative game system is as 
follows. A power switch (not shown) Is turned on render- 
ing the game system operative. When this is done, if the 
storage 30 is set in driver 19 then CPU 1 operates 
based on the OS in ROM 6 to instruct driver 19 to read 
the program data out of storage 30. In responding, 
driver 19 reads from storage 30 video, audio and pro- 
gram data, which are supplied to decoder 17 for execu- 
tion of enror correction processing. The resulting en-or- 
corrected image data from decoder 1 7 are then passed 
via bus 2 to expansion circuit 7, which attempts to per- 
form the expansion processing stated supra generating 
expanded data which are then fed to drawing processor 
10. Ttiis processor 10 writes Input data into the nondis- 
play area of buffer 1 1 . Additionally, resultant audio data 
error-corrected at decoder 17 are routed to audio proc- 



essor 13 for being written into either main memory 5 or 
buffer 14. 

Similarly, the program data error-conected at 
decoder 17 are fed to main memory 5 and written 

5 therein. During operation following this. CPU 1 provides 
control based on the game program data stored In 
memory 5 and contents of any instructions from the 
game player through controller 22 to ensure that the 
game progresses in an expected way. In other words, 

10 CPU 1 is responsive to receipt of instructions or com- 
mands from the player via controller 22 for adequately 
providing Image processing control, audio processing 
control, and internal processing. The image processing 
control may involve later-described calculation of coor- 

75 dinates of each skeleton, calculation of coordinates of 
polygons, supplying resultant 3D coordinate data and 
viewpoint position data to graphics data generation 
processor 3. issuing drawing commands containing the 
address data in the display area of buffer as determined 

20 by graphics data generation processor 3 and assoda- 
tive intensity data, and others. The audio processing 
control may include issuing audio output commands to 
processor 13. assigning levels and reverve and the tike. 
The internal processing control may be computation in 

25 deference to operations of controller 22. for example. 

See Fig. 2, which shows inherent functions the 
CPU 1 of Rg. 1 may offer. CPU 1 has these functions of 
Fig. 2 as a result of reading the program data from stor- 
age 30 of Fig. 1 and written Into main memory 5. The 

30 functions of Fig. 2 are attained by a button operation 
detector unit 1a for detecting which button is presently 
activated, viewpoint position data setter 1b for defining 
camera viewpoint in the 3D space, display range infor- 
mation extraction unit 1c for determining a display 

35 region to be indicated on TV monitor 12, skeleton calcu- 
lator 1d for executing later-described first and second 
arithmetic operations, polygon calculator 1e, drawing 
command issuance unit If, and Intensity processor 1g. 
This embodiment is designed so that displaying of a 

40 character(s) on TV monitor 12 is carried out based on 
control of rotation amount with respect to skeletons, as 
will be described below. 

An explanation will first be given of tiie principle of a 
series of motions of a model using skeletons in conjunc- 

45 tion with Rgs. 3 tiirough 7. 

Fig. 3 illustrates one extracted graphics image com- 
ponent representative of an arm section of a character 
shown in Fig. 26. More specifically, tiie image of Fig. 3 
is structured from three skeletons SKO to SK2 covering 

so from a root SO of an arm section up to its hand M2 witii 
a plurality of models being associated therewith, whk;h 
models con-espond to muscle at respective skeletons 
SK. The term "moder. as used herein may refer to a sin- 
gle surface figure belonging to its con*esponding one 

55 skeleton, which may consist of a predefined number of 
polygons and a texture that may be a picture pattern as 
adhered to each skeleton. 

It is to be noted that in the following description. 
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some specific abbreviated expressions will be employed 
which follow: 

WRK: Memory address at which the absolute coor- 
dinates of a character is stored. 
ADD: Memory's top address whereat movement 
data are stored. 

BON: Memory's top address where each skeleton 
data item is stored. 

PAT: Pattern data included in one movement of a 
selected character. 

Proot* Spatial coordinates of character (same as 
coordinates of an origin of skeleton SKO). 
GET: Intermemory top address of a selected char- 
acter pattern, as given by GET = F(ADD,PAT). 
Root: Skeleton SKO directly coupled to the charac- 
ter's spatial coordinates (origin). 
SO, S2: spatial coordinates of skeletons SKI , SK2 
(vector). 

Br^: Length of each skeleton SK (scalar). 

RO: Angle of skeleton SKO (r^, Ty r^, 

Rx(a): Rotation matrix for rotation a relative to X 

axis. 

Ry(P): Rotation matrix for rotation p relative to Y 
axis. 

R2(y): Rotation matrix tor rotation y relative to Z 
axis. 

Addtltonally, the root is for determination of a refer- 
ence position or location of the character per se; the 
root's position is indicated as the arm's root SO for pur- 
poses of convenience of explanation only. 

Assuming that the spatial coordinates of one end- 
point or tip of skeleton SKO is identical to the root end of 
skeleton SKI (the same goes with the relation between 
a lower stream of skeleton and its following skeleton), 
the spatial coordinates S1 of an Immediately lower 
stream of skeleton SKI may be defined using the follow- 
ing formula: 

S1=S0+Ry(ry) • Rx(r J • Bz{r^) • Bro (1) 

Further, using the resulting coordinates SI of skeleton 
SK1 as obtained from Formula (1) and skeleton SKVs 
rotation amounts Rx(a), Ry(p), Rz(y) as well as length 
Bri. the spatial coordinates of skeleton SK2 may be 
represented as: 

S2=S1+Ry(ry) • Rx(r J • Bz{r^) • Br ^ (2) 

In this way. It is possible at skeleton calculator Id (by 
sequentially applying the relation between a "parent" 
skeleton and its "child'* skeleton to a lower side) to 
obtain Intended spatial coordinates of any lower stream 
or dovt^stream of skeleton SK. 

This relation will be explained with reference to Fig. 
3. Obtain from Fonnula (1) the coordinates of a tip of 
skeleton SKO. i.e. the coordinates Si of the base end of 



skeleton SKI. Then, also use Formula (1) determining 
the coordinates of a tip of skeleton SKI, namely the 
coordinates of base end of skeleton SK2. Recurrently 
executing such calculations results in determination of 

5 the spacial coordinates of all the skeletons SK0-SK2. 

And, during the next frame period (1/30 sec), if dif- 
ferent rotation amount parameters Rx(a), Ry(p), R2(y) 
are added to each skeleton SK then execute based on 
such rotation amount the arithmetic operations of For- 

10 mulas (1) and (2) sequentially along a route from the 
root toward the downstream direction, thus defining the 
base end coordinates of skeletons SKI , SK2 as new 
values S1 S2'. Next, let the polygon calculator 1 e again 
calculate or recalculate based on the rotation amount 

75 and length Br^ of each skeleton the vertex coordinate 
data of polygons fonning respective models M0-M2; 
pass the result to the graphics data generation proces- 
sor 3 for calculation of spatial coordinates; ard further, 
allow the drawing processor 10 to receive the instruc- 

20 tion(s) issued from the drawing command issuance unit 
1f and accomplish visual representation of any intended 
actior© such as arm's upward bending as shown in Fig. 
3. Note here that while the illustrative skeleton shape is 
like an an-owhead for pictorial clarity purposes only. 

25 such skeletons are toots for polygon mapping which will 
never be displayed in actual scenes of TV games. 

See Fig. 4. This shows a table of the main memory 
5 which stores therein vertex coordinate data of a pre- 
defined number of polygons forming a model associ- 

30 ated with each skeleton SK. which data are read out of 
storage 30. As shown in Rg. 4. a plurality of polygons 
forming each model are stored in a manner such that 
certain polygons shiftable and rotatable in response to 
each skeleton's movement are on a con-espondence 

35 bases. More specifically, the vertex coordinate data P of 
a polygon belonging to a given skeleton SKn may be rel- 
atively defined with respect to this skeleton's spatial 
coordinates Sn, rotation amount Rx(a), Ry(p), Rz(y), 
and length Br^,. Accordingly, upon determination of the 

40 coordinates Sn and rotation amount parameters Rx(a). 
Ry{P), Rz(y) as well as length Brp of the skeleton SKn, 
there are defined by calculation in responding thereto 
the position and attitude Cmdination. rotation angle) on 
the spatial coordinant system of polygon Pn belonging 

45 to such skeleton SKn. In the example of Fig. 4, the ver- 
tex coordinates and angle data of polygons P01 , P02,... 
may be related to skeleton SKO; the vertex coordinates 
and angle data of polygons P11. P12,..., Pin may be 
related to skeleton SKI ; and further, tiie vertex coordi- 

50 nates and angle data of specified number of polygons 
will be related to any subsequent skeletons. Note that 
the number of polygons belonging to each skeleton SKn 
may be variable depending upon rnodels as employed. 
Rg. 5A shows a data table of the main memory 5 

55 for explanation of the top address GET (=ADD, PAT) in 
the memory of a selected character pattern, wherein 
several kinds of motions are stored in a con-espondence 
manner, which actions may include walk (WALK), run 
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#1 (RUN1). run #2 {RUN2) jump (JUMP) and others: 

where necessary, any additional desired motions or 
actions such as punch, kick, rotate, etc. (not shown) are 
stored correspondingly as far as these are recognizable 
by the operation buttons of controller 22 the game 5 
player operates by his or her fingers, or in some situa- 
tions that one or more buttons thereof may be switched 
in function mode to another specific action instruction 
when the character being displayed is in certain action 
stages. When depressing a button Instructs one action. 10 
a storage content Is read out of its corresponcGng 
address ADD. As shown in Fig. 5B. this storage content 
is rotation amount Rx(a), Ry(p), Rz(y) data of each skel- 
eton for causing a frame image at one scene of such 
action to execute a series of motions which are be given 15 
to each of polygons covering from the first pattern data 
up to n-th pattem data. And. by reading the pattern data 
in the frame period and performing calculations similar 
to those of the aforesaid Formulas (1) and (2) as well as 
computation of the polygon vertex coordinates and rota- 20 
tion angle in the spatial coordinate system based on the 
calculation results, polygon vertex coordinates of Fig. 4 
and angle data, it becomes possible to sequentially dis- 
play frame images on the screen. Additionally.the pat- 
tern data indicative of such series of motions are such 25 
that regarding WALK for example, the first to n-th pat- 
tern data items are recurrentiy read enabling a walking 
action to be attained continuously. 

Next, the procedure of calculating the coordinates 
of skeletons forming a model in the spatial coordinant 30 
system will be explained in conjunction with Figs. 6 and 
7. Fig. 6 shows one exemplary character model with five 
skeletons whereas Rg. 6 is a flowchart of the skeleton 
coordinate calculation routine as executed by the CPU. 

First, set an address at the root (designated by 
"ROOT" in the drawing). Mae specifically, after setting 
as Proot the coordinate data SO of skeleton SKO (I.e. 
parent) at step ST1, calculate the coordinates SI of tip 
of skeleton SKO. namely at the base end or root of 
"child" skeleton SK1 (at step ST3. the coordinates of ® 
of Fig. 6). Then, determine whether any child skele- 
ton(s) not subject to such coordinate calculation yet 
is/are present (at step ST5). Looking at from 0 of Fig. 
6, ® and ® are not subject to intended calculation yet; 
therefore. ® Is first calculated. More precisely, since 
YES at step ST5 then the routine goes next to step ST7 
for setting as the coordinates of skeleton SKI 's root end 
the coordinates of skeleton SKO's tip end as obtained at 
step ST3. And, calculate the coordinates of child skele- 
ton SK2's tip end with a new skeleton SKI being as its 
parent (at step ST3, the coordinates of @ of Fig. 6). If 
any child skeleton is present in tiie downstream of the 
present skeleton of interest, namely, if YES at step ST5, 
the routine repeats the processings of steps ST3 and 
ST7 thereby obtaining up to the coordinates of ® of 
Fig. 6. After completion of the coordinates of ® of Fig. 
6, since no child skeletons are present in the down- 
stream thereof (NO at step ST5), determine whether a 



parent skeleton is present (at step ST9). Since (g) cor- 
responds to such parent at ® of Fig. 6. the routine rec- 
ognizes presence of parent skeleton and thus goes to 
step ST1 1 . At step ST1 1 the coordinates of ® of Fig. 6 
are set letting the routine go back at step ST5. Since no 
children are present at (g) of Fig. 6. the routine 
progresses to step ST9 for determining if any parent 
skeleton exists. Since 0 is present as the parent at @ 
of Fig. 6 (YES at step ST9), the routine goes to step 
ST1 1 which sets the coordinates of ® . Here, a child as 
designated by ® is associated with 0 (YES at step 
ST5), set the coordinates of 0 as a child/skeieton's root 
end coordinates (at step ST7); then, calculate tiie coor- 
dinates of @ at.step ST3. 

After completion of the ®'s coordinate calculation, 
tiie routine returns to the root via ® in a manner similar 
to that discussed supra, for calculating the coordinates 
of © of Fig. 6 at step ST3. In this way, when returning 
to tiie root after completion of coordinates with respect 
to all available child skeletons (NO at both step ST5 and 
step ST9), the skeleton calculation is terminated. 

And, when the skeleton coordinate calculation 
shown in Rg. 7 is completed, calculate the vertex coor- 
dinates and angle data of polygons being displayed 
based on tine resulting skeleton tip-end coordinates, tiie 
rotation amount read from the table of pattern data, and 
lengtii data; and further, execute texture adhesion 
processing after conversion to vertex coordinates and 
rotation angle on the 2D display screen. 

Fig. 8 shows a display routine as executed by CPU 

1. 

The display routine is for visually indicating a char- 
acter(s) on a game screen while allowing the character 
being displayed to move or take actions in accordance 
with instructions from controller 22. Upon initiation of 
the display routine, read the top address ADD of move- 
ment data out of the nondisplay area of txiffer 1 1 storing 
therein image data, and also read a selected character 
pattem PAT for obtaining the top address GET of such 
selected character pattern from the both data items (at 
step ST21). Then, read the rotation amount as stored in 
tiiis top address GET— namely, the rotation amount 
data of each skeleton— thereby executing a subroutine 
of "skeleton calculation" shown in Fig. 7. Subsequentiy, 
at step ST25. execute the flow of a "model display" sub- 
routine completing the display routine. 

Rg. 9 is a flowchart of tiie "model display" subrou- 
tine at the step ST25. 

Rrst. read character's absolute coordinates in the 
nondisplay area (memory) of buffer 11 as indicated by 
tiie value of address variable or parameter WRK (at 
step ST31). Then, let the polygon calculation unit 1e 
obtain tiie polygon vertex coordinate and angle data 
from the spatial coordinates of a skeleton (equivalent to 
STO) and its rotation amount supplying the data, light 
source vector and normal vector information to tiie 
graphics data generation processor 3 (step ST33). 
Graphics data generation processor 3 is responsive to 



40 



45 



SO 



10 



19 



EP0840 256 A2 



20 



such data items supplied thereto for converting the pol- 
ygon vertex coordinate data to 2D coordinates (x.y) cor- 
responding to the display screen while sinnultaneously 
determining the luminance on polygon surface as 
obtainable from the polygon angle data, light source 5 
vector, and normal vector information for storage 
therein. Then, determine or "judge" whether display 
request has been issued with respect to all the polygons 
relating to or associated with a skeleton of interest (step 
ST37). If such processing for all the polygons associ- 10 
ated with the skeleton of interest then return at step 
ST33 to recurrently perform the processings of steps 
ST33 and ST35. 

On the other hand, when the display processing 
was completed for all polygons associated with the skel- 15 
eton of interest, determine whether any skeleton is still 
present which is not subject to such polygon displaying 
processing (at step ST39). If such unprocessed skele- 
ton is found then look at the next skeleton (at step ST41 ) 
and retum at step ST33 for execution of steps ST33- so 
$127 in a way similar to that stated supra. 

After completion of intended polygon display 
processing with respect to all available skeletons (YES 
at step ST39), read out of memory (nondisplay area of 
buffer 11 ) the resultant coordinates (x.y) and luminance 25 
data then supplying them to drawing processor 10 as 
drawing instructions along with the texture data and 
color palette address data (at step ST43). Then, deter- 
mine whether all data items are transfen^ed to drawing 
processor 10 (step ST45): if any data are still present 30 
then return at step ST43 for continuing tiie data trans- 
mission processing. When transmission of ail data 
items is completed, terminate this flow of prosecution. 
The foregoing processing is performed within a single 
frame period. 3s 

The relation of skeletons versus models will next be 
explained in conjunction with one exemplary character. 

Figs. 10A through 12B show a first exemplary ani- 
mation character as employable in the system of this 
invention, wherein Fig. 10A depicts a front view of the 40 
character being displayed which is in a standard or 
"neutral" attitude state, Rg. 1 0B is Its side view, Rg. 1 1 A 
is a front view of the character which is in a vertically 
elongated or "stand up" state, Fig. 1 1B is its side view, 
Fig. 12A is a front view of the character in a vertically 45 
shrunk or "crouch" state, and Rg. 1 1B is a skJe view 
tiiereof. 

See Figs. 13-15 which illustrate tiie first exemplary 
animation character using skel^ons and polygons, 
wherein Fig. 13 is a side view of the character in the 50 
neutral state, Rg. 14 is a side view of the same in stan- 
dup state, and Rg. 15 is a side view of the same in 
crouch state. See also Rgs. 16-17 which show the first 
character with its ears and legs added thereto, wherein 
Fig. 1 6 is a front view whereas Fig. 1 7 is a side view. 55 

As may be seen from Rgs. 10A-12B, the graphics 
object 40 may be an animation character "casted" in TV 
game programs which is deformation of an "animal" that 



generally resembles cutjic in body shape; more specifi- 
cally, character 40 comes with a face section 41 , a pair 
of ears 42 on the top thereof, and botii legs 43 at its bot- 
tom. Note in Figs. 13-1 7 that certain ti-iangles and/or tri- 
angles forming such cubic surface and hand/leg 
surfaces indicate polygons whk:h are adhered witii tex- 
ture constituting character 40. 

In Figs. 13-17, a specific point Proot centrally 
defined on the face 41 defining the origin of tiie charac- 
ter's coordinant system while causing tiiis origin to be 
coupled witii an auxiliary skeleton SK21 which extends 
in a vertical downward direction and two serial auxiliary 
skeletons SK22. SK23 extending to approach tiie upper 
side. Coupled to the tip end of auxiliary skeleton SK21 
extending downwardly from the origin are four lower 
skeletons SK11-SK14 in a parallel (like an umbrella) in 
the front, rear, right and left directions {especially, see 
Fig. 16). Four intermediate skeletons SK31-SK34 of an 
umbrella shape are parallel coupled in tiie four direc- 
tions to the tip of auxiliary skeleton SK22 serially cou- 
pled together and extending from the origin upwardly; 
similarly, four upper skeletons SK41-SK44 are coupled 
to that of auxiliary skeleton SK23. 

Rgs. 16 and 17 show ears 42 and legs 43 of char- 
acter 40. In Figs. 16-17. each ear 42 is associated with 
four skeletons SK50-SK53 as serially coupled from ttie 
distal end of auxiliary skeleton SK22 whereas each leg 
43 is with four skeletons SK54-SK57 as series-coupled 
from that of auxiliary skeleton SK21. Furtiier, right and 
left eyes 44 are associated witii skeletons SK58-SK59 
as serially coupled from the tip of auxiliary skeleton 
SK23. 

It should be noted that while tills embodiment 
assumes that tiie origin Proot be identical to the base 
end of auxiliary skeleton SK21 for purposes of conven- 
ience of explanation only, the origin Proqt may alterna- 
tively be set at the leg position, i.e.. theMocation of 
auxiliary skeleton SK50 for interconnection witii tiie 
base end of auxiliary skeleton SK21 witii at least one 
auxiliary skeleton (not shown) being laid therebetween 
thereby letting tiie position of origin Proot be deviated 
from tiie auxiliary skeleton base end. where necessary 
under arithmetic operation design. 

A deformation operation of the cubic section form- 
ing the character's face section 41 will be explained 
which is a significant feature unique to the present 
invention. Polygons forming face 41 are exclusively 
associated witii the lower skeletons SK1 1 -SKI 4, inter- 
mediate or "mid" skeletons SK31 -SK34, and upper skel- 
etons SK41-SK43, respectively, in a subdivided manner 
such ttiat while the cubic structure Is vertically subdi- 
vided into tiiree approximately equal portions, those 
polygons forming the surface of its lower portion are 
associated with lower skeletons SK1 1 -SKI 4. those pol- 
ygons forming the intermediate surface portion are witii 
mid skeletons SK31 -SK34, and tiie remaining polygons 
forming the upper surface portion are with ttiose skele- 
tons SK41-SK44. The lower, mid and upper polygon 
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modules are structured so that each defines a corre- 
sponding confibination of four 90-degree divided compo- 
nents M11-M14, M21-M24 or M31-M34. Accordingly, 
this embodiment may offer capability of attaining shape 
changes or deformations for a respective one of twelve 
(12) regions as subdivided by skeletons SK11-SK14, 
SK31-SK34 and SK41-SK44 circunnferentially into four 
parts each having 90 degrees and vertically Into three 
sections. 

Vertical expansion and shrink deformations may 
depend upon the auxiliary skeletons SK21-SK22 
whereas horizontal or lateral expansion/shrink shape 
changes are dependable on skeletons SK11-SK14. 
SK31-SK34 and SK41-SK44. 

More particularly, where the character being dis- 
played is in the neutral state shown in Fig. 13, the auxil- 
iary skeleton SK31 is tilted or inclined backwardly by 
approximately 30 degrees, for instance, while the auxil- 
iary skeleton SK22 coupled to the tip of auxiliary skele- 
ton SK21 is inclined in the opposite direction thereto 
causing its tip end to return onto the vertical center axis. 
Also in such neutral state, the lower skeletons SK11- 
SK14 are directed almost horizontally with mid skele- 
tons SK31-SK34 and upper ones SK41-SK44 facing 
downwardly by about 30 degrees, respectively. Then, 
calculate polygon vertex coordinates and angle data of 
respective models Ml 1 -Ml 4, M21-M24 and M31-M34 
associated with such skeletons SK11-SK14, SK31- 
SK34 and SK41-SK44, respectively. 

In Fig. 14 showing the "standup" state, the auxiliary 
skeletons SK21. SK22 are in approximately parallel to 
the center line in the vertical direction with the charac- 
ter's body length or height being extended vertically. 
Also in this state, the lower skeletons SK11-SK14 are 
tilted by 20 to 30 degrees to the upward direction 
whereas the mid skeletons SK31-SK34 and upper ones 
SK41 -SK44 are inclined about 45 degrees to the down- 
ward direction, respectively. In other words, by extend- 
ing the height while causing respective skeletons SK1 1 - 
SK14, SK31-SK34 and SK41-SK44 to rapidly increase 
in inclination, each polygon's surface is likewise inclined 
vertically attaining lateral shrink due to such extension 
of body height. Also, in order to eliminate occurrence of 
any dead spaces or gaps between upper and lower 
adjacent polygons, each polygon is designed to have a 
selected size that partly overlaps its neighboring one at 
its peripheral face edges even in the standard or "neu- 
tral" state while at the same time employing a selected 
color which is the same as or similar to that of its neigh- 
bomg polygon(s) to ensure that such overlapping does 
not result in unnatural linkage of colors at boundaries 
therebetween. 

On the contrary, in Fig. 1 5 that depicts the shrunk or 
"crouch" state, the auxiliary skeletons SK21, SK22 are 
forced to further increase in inclination while simultane- 
ously letting respective skeletor© SK11-SK14, SK31- 
SK34 and SK41-SK44 decrease in inclination 
adversely. Reducing or moderating the inclination of a 



respective one of the skeletons SK11-SK14. SK31- 
SK34 and SK41-SK44 may allow each polygon to be 
horizontally laid down accordingly to thereby ensure 
that when the character's height decreases, resultant 

5 lateral diameter is likewise increased providing visual 
enhancement to the character's body height shrinkage. 

The animation character 40 is changeable in on- 
screen appearance in response to operations and 
instructions from the controller 22: by way of example, 

10 when the character jumps, its body height is displayed 
so that it increases as shown in Fig. 14; when the char- 
acter lands on the ground, it shrinks Or aouches as 
shown in Fig. 15. It is thus possible to display on the 
monitor 21 exact and precise expansion/shrinking proc- 

15 ess of the character 40. by setting so that the auxiliary 
skeletons SK21, SK22 contnuously vary incrementally 
or decrementally in angle of inclination in response to 
e\/ery slight change of pattern data (first pattern data to 
n-th pattern data) with respect to each of polygons that 

20 define motions of models Ml 1 -M34 associated with the 
skeletons SK11-SK14, SK31-SK34 and SK41- 
SK44-H.e. each rotation amount Rx(a). Ry(p). Rz(y) of 
skeletons SKI 1-SK14, SK31-SK34 and SK41-SK44. 
Accordingly, it is possible to permit the character to 

25 exhibit a variety of shape change actions by employing 
also for such mere cube-like (t)all-shaped) character 
with no joints and no bones the auxiliary skeletons 
SK21. SK22 with no associative polygons located ther- 
ebetween and utilizing specific skeletons that are varia- 

30 ble in rotation amount in operatively response to the 
inclination angle of auxiliary skeletons SK21 . SK22. 

Rgs. 18A-19B are pictorial representations of the 
outer appearance of a second exemplary animation 
character as employable in the present invention, 

35 wherein Fig. 18A and 18B depict a front view and side 
view of the character which has its eyes open whereas 
Fig. 19A-19B are a corresponding front view and side 
view the same with Its eyes closed. 

Rgs. 20 and 21 illustrate the head section of the 

40 second exemplary character which is represented by 
skeletons and polygons, wherein Fig. 21 shows a side 
view of it in the eye-opened state whereas Fig. 22 is a 
side view thereof in the eye-closed state. 

As can be seen from viewing Rgs. 18A-21 . the car- 

45 toon character 60 is a human-resembling one which has 
at upper half portion of head 61 a pair of upper and 
lower eyelids 63. 64 for opening/closing its pupil 62. The 
origin Prqot "o* shown herein is set at the character's 
waist section, by way of example, while providing a skel- 

50 eton (not shown) extending from it to its neck section 
w'rth the tip thereof being identical to the coordinates of 
the base end of a skeleton SK61 (defining actions of tine 
entire head section) extending to the head interior. Pro- 
vided at the tip of skeleton SK61 is an auxiliary skeleton 

55 SK62 that IS provided pointing at the head section. Two 
skeletons SK63, SK64 are provided at the tip of tinis 
auxiliary skeleton SK62 tor use in opening and closing 
tiie eyelkis 63, 64 in a way such that these skeletons 



12 



23 



EP0 840 256A2 



24 



extend forwardly at upper and lower levels correspond- 
ing to eyelids 63, 64; a further skeleton SK65 is pro- 
vided therebetween for use in letting pupil 62 move in 
the up/down and right/lefl directions. 

Frames shown In Figs. 20-21 represent polygons 
respectively: the upper eyelid 63 Is structured from a 
model M61 consisting of three polygons along the 
up/down directions and is associated with the skeleton 
SK63; similarly, the lower eyelid 64 is configured of a 
model M62 consisting of three polygons in the up/down 
directions and is associated with skeleton SK64. These 
skeletons SK63, SK64 are rotatable exclusively in 
selected— up/down or vertical— directions relative to the 
character's face. Additionally, the skeleton SK54 permit- 
ting movement of pupil 62 is rotatable in up/down and 
righl/l^ directions relative to the face. The skeleton 
SK61 Is associated with a model M60 consisting of 
remaining polygons of the head 60 so that a change in 
rotation amount of skeleton SK61 allows head 61 to 
move In up/down and right/left directions. 

In Fig. 20. the skeleton SK63 is tilted by 20 degrees 
or more or less in the front upper direction whereby the 
model M61 associated with skeleton SK63 is likewise 
inclined by the same angle upwardly (letting the upper 
eyelid open). The skeleton SK64 is tilted by approxi- 
mately 20 degrees in the front lower direction whereby 
the model M62 associated with skeleton SK64 is like- 
wise inclined downward by the same angle (letting the 
lower eyelid open). 

On the other hand, in Fig. 21, the skeletons SK63, 
SK64 face fonward; due to this, the models M61. M62 
associated with skeletons SK63, SK64 are each 
directed at the forward direction (closing the eyelids). 

As shown in Figs. 20-21 . the character 60 opens or 
closes its eyelids 63, 64 in response to operation com- 
mands from the controller 22 or alternatively In conform- 
ity with scenes and/or criteria in the progress of a TV 
game installed. Hence, it is possible to display on moni- 
tor 12 delicate motions or actions such as the character 
60's eye-open/close motions, by setting the inclination 
angle of skeletons SK63, SK64 such that these continu- 
ously vary significantly or insignificantly so as to opera- 
tively respond to every minute or fine change of the 
pattern data (first pattern data to n-th pattern data) with 
respect to each of certain polygons defining movement 
of the models M61, M62 associated with skeletons 
SK63, SK64— i.e. each rotation amount Rx(a), Ry(p). 
Rz(y) of skeletons SK63. SK64. 

With such an arrangement, it becomes possible to 
permit the models M61, M62 to precisely perform sev- 
eral desired, more natural actions by making use of 
even for the models M61. M62 with no joints and no 
bones the skeleton SK62 without having any associa- 
tive polygons thereby to provide skeletons SK63. SK64 
at any desired positions while letting the models M61, 
M62 with no joints/bones be associated with the skele- 
tons SK63. SK64. 

It should be noted that while in the foregoing 



embodiment the open/close operations of eyelids 63. 61 
are responsive to operations/commands from the con- 
troller 22 stated supra, the same may alternatively be 
modified in a way such that the same is also performa- 

5 ble when the character's emotional representation is to 
be visually indicated in cases where the character pulls 
itself up for a fighting posture or adversely is damaged 
by its contested party or "enemy" in the virtual world of 
fighting TV games. Additionally, upper part of the model 

10 M61 and lower part of model M62 are designed to over- 
lap model M60 with inaeased priority (subject to hid- 
den-surface processing as the front surface) thereby 
ensuring that no gaps occur between models M61 . M62 
and model M60 even when the eyelids 63, 64 are 

75 closed. 

Adding certain rotation amount to the skeleton 
SK65 associated with the eye 62 may enable eye 62 to 
move vertically, i.e. upwardly or downwardly. Figs. 22A- 
22B are front view diagrams showing eye 62's move- 

20 ment, wherein Fig. 22A illustrates one state in which eye 
62 looks left wherein Fig. 22B depicts another state in 
which eye 62 looks up. Additionally. Fig. ISA shows the 
state in which eye 62 looks front. This may be modified 
so that eye 62 is modelled with its eyeball and pupil 

25 being separate and independent parts as divided there- 
from for permitting skeleton S65 to move only the pupil 
in the up/down and right/left directions. 

See Fig. 23 which shows a perspective view of a 
third exemplary cartoon character image as also appli- 

30 cable to the present invention, and Fig. 24 depicts the 
upper half part thereof including hair of the third charac- 
ter, which part is represent by skeletons and polygons. 

It can be seen from Rgs. 23 and 24 that the charac- 
ter indicates a woman or giri with long hair 71 . Although 

35 not particularly shown herein, it has the origin Proot a* 
its waist position; a skeleton (not shown) is provided 
which extends from such position to the neck and has Its 
top end to which an auxiliary skeleton SK70 extending 
toward the back side of the head is coupled. This auxil- 

40 iary skeleton SK70 has its tip as coupled to a serial 
combination of a predefined number— five, here— of 
skeletons SK71-SK75. Respective skeletons SK71, 
SK72. SK73, SK74. SK75 are associated with models 
M71 , M72, M73, M74, M75 representative of segments 

45 of the hair 71 as grown from the backside of her head, 
respectively. 

The "girl" character 70 is designed to perform 
intended actions WALK. RUN1. RUN2, JUMP, etc., 
which are responsive to operations/commands of the 
50 controller 22. As the character 70 moves, hair bending 
or waving movement is given thereto in accordance with 
its motions. Such hair waving may be settable by the 
rotation amount of one or more skeletons SK in charge 
ofthistESk. 

55 Then, pattern data (first to n-th pattern data) relat- 
ing to each polygon defining movement are given to the 
skeletons SK71-SK75. More specifically, respective 
rotation amount parameters Rx(a), Ry(p). Rz(y) which 
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are thef irst to n-th pattern data with respect to each pol- 
ygon as set to the individual one of skeletons SK71- 
SK75 are designed enabling associative one of models 
M71-M75 to exhibit more natural wavy movement. It is 
thus possible, by letting such set pattern data gradually 
vary by minute degree, to display on monitor 12 almost 
natural waving movement of models M7VM75 in 
accordance with the character 70's motions. 

In this way. it is possible to allow models M71 -1^/175 
to exhibit any desired, more natural and precise hair 
waving movement, by employing the auxiliary skeleton 
SK70 with no associative polygons even for the models 
M71-M75 having no joints and no bones and also pro- 
viding skeletons SK71-SK75 of any desired lengths at 
desired positions while letting the models M71 -M75 with 
no joints and no bones be associated with these skele- 
tons SK71-SK75. 

It should be noted that although not particularly 
illustrated, the neck section has a skeleton for instruc- 
tion of bending and/or rotation, and further, if necessary, 
the skeleton structure similar to that of the second 
example discussed supra is employed for the eye sec- 
tions, thereby enabling attainment of precise eye move- 
ment and eyelids* open/close motions. 

Figs. 25A-25B show the upper half of a fourth 
exemplary cartoon character as applicable to the inven- 
tion which consists of skeletons and polygons to repre- 
sent a young lady's naked chest, wherein Fig. 25A is a 
side view whereas Fig. 25B is a front view thereof. 

As can be seen from Figs. 25A-25B, the *'lady" 
character object 80 has a skeleton SK80 that extends 
upward from "her" waist corresponding to the origin 
^ROOT This skeleton SK80 has its tip end from which a 
skeleton 8K81 extends along "her" vertebral column; 
this skeleton SK81 In turn has its tip to which a parallel 
corrd^ination of two auxiliary skeletons SK82, SK83 is 
coupled so that these project frontward to right and left 
breasts 81, 81. These skeletons SK82, SK83 are with 
skeletons SK84. SK85 which extend into interior spaces 
of breasts, respectively Note here that those skeletons 
SK extending from the tip of skeleton SK80 to the head 
and both arm sections are not important in this inven- 
tion; accordingly, an explanation thereof is eliminated 
herein. 

The skeletons SK84. SK85 are dedicated in func- 
tion to breasts* movement In a manner such that the 
model M81 consisting of multiple polygons representa- 
tive of the left breast is associated with the skeleton 
SK84 whereas model M82 made up of multiple poly- 
gons indicative of the right breast is associated with 
skeleton SK85. 

The "lady" character 80 is designed to perform sev- 
eral intended actions WALK, RUN1, RUN2, JUMP and 
the like. Such motions of the character 80 may provide 
sway or swing nrK)vement of "breast" models M81 . M82 
In accordance therewith. The breast swing movement is 
settable by the rotation amount of skeletons SK84. 
SK85 as dedicated thereto. 



Then, the skeletons SK84. SK85 are given with cer- 
tain pattern data (first pattern data to n-th pattern data) 
with respect to each polygon defining movement. More 
specifically, each rotation amount parameter Rx(a), 

5 Ry(P). R2(y) being the first to n-th pattern data for each 
polygon as set for the individual one of skeletons SK84. 
SK85 is designed so that it is capable of reproducing 
more natural sway of the models M81 , M82 associated 
tfierewith, including but not limited to playback of the 

10 breasts' simultaneous up/down or vertical swing, alter- 
nate vertical swing, or lateral swing, or even diagonal 
shaking. Thus, it becomes possible, by letting such set 
pattern data gradually vary by minute degree, to displ^ 
on monitor 12 almost natural swaying movement of 

75 models M81, M82 In responding to the character 70's 
motions. 

In this way, by employing the auxiliary skeletons 
SK82. SK83 with no associative polygons even with 
respect to the models M81 . M82 having no joints and no 

20 bones and providing skeletons SK84, SK85 of any 
desired lengths at desired positions letting the models 
M81, M82 with no joints and no bones be associated 
with these skeletons SK84. SK85. it is possible to allow 
models M81, M82 to exhibit desired, more natural and 

25 precise swaying or swinging movement of the breast 
images 81 . 

It should be noted that the models M81. M82 over- 
lap in part the model M80 at the body to ensure that no 
gaps take place between themselves and model MSG 

30 even when models M81 . M82 move vertically 

It should also be noted that where the tiiird and 
fourth exemplary 3D cartoon characters 70, 80 are for 
use in some fighting TV games, these are specifically 
designed such that the models M71-M75 or M81-M82 

35 move more naturally as the character exhibits actions 
as taken in attacking or defending scenes otiier than the 
motions such as WALK, RUN and the like. Additionally, 
the hair waving as attainable by tiie models M71 -M75 
may also be applicable to like movements of animals 

40 with much body hair. 

It has been described that in accordance with the 
broadest concepts of the apparatus, method and teh 
storage medium of teh present invention, since an aux- 
iliary skeleton not relating to and independent of models 

45 is specifically an-anged on the upstream side of the low- 
est stream of skeleton, it is possible to increase the 
degree of freedom as to disposing the skeleton in tiie 
lowest stream for defining its corresponding model at a 
desired position preferable for the shape of a character 

50 upon setting of tiie character's relative position attitude. 
Whereby, settings of the relative position attitude of tiie 
lowest stream skeleton and its corresponding model 
may be made much easier while simultaneously ena- 
bling the model to be given with the system designer's 

55 desired precise motions or actions. Also, since the aux- 
iliary skeleton remains free from model displaying oper- 
ations, tiie system designer may be permitted to take 
into consideration only the positional relation witii tiie 
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lowest skeleton, making the settings much easier 

In accordance with the specific form of the inven- 
tions, a deformabie constituent portion is formed at part 
of the character being displayed while arranging respec- 
tive skeletons corresponding thereto in a way such that 
these are in relation to each other with the rotation 
amount data for use in moving corresponding models 
being stored in the time-axis direction. In such a form of 
the invention, it is possible to design variations or 
changes in shape of certain parts relative to those por- 
tions that do not inherently have any joints— such as 
vertical or lateral or even simultaneous deformation of 
cube-like objects, waving of long hair (hair of human 
females, animal's tails or the like), open/dose of top and 
bottom eyelkls. or sway of a pair of breasts— as the con- 
tent in the time elapse direction such as models of the 
constituent portions cooperatively exhibiting precise 
movement. 

While the invention has been particularly shown 
and described with reference to preferred emt}odiments 
thereof, it will be understood by those skilled in the art 
that the foregoing and other changes in form and details 
may be made therein without departing from the spirit 
and scope of the invention. 

Claims 

1. Apparatus for generating a skeleton-based mova- 
ble picture image comprising storage means (30) 
for storing therein spatial coordinate data of skele- 
tons (SK) coupled together and models (M) associ- 
ated with respective skeletons, and calculator 
means (1 , 3) for sequentially taking the skeletons 
out of said storage means (21) in a predefined 
order and for calculating based on resultant data 
the display position of a model associated with 
each skeleton on a two^iimensional display screen, 
characterized in that said storage means (30) 
stores an auxiliary skeleton (SK21-SK23, SK31, 
SK50, SK62. SK70. SK80-82) not relating to a 
model (M) at certain location con-esponding to an 
immediate upstream side of a lowest stream of 
skeleton. 

2. Apparatus for generating a skeleton-based 
dynamic picture image comprising storage means 
(30) for storing therein skeletons (SK) as provided 
for defining relative positional attitude of polygons 
acting as display elements of a character (40, 60, 
70, 80) and a mode! essentially consisting of a pre- 
d^ined number of polygons as associated with 
each sakl skeleton, and arithmetic processor 
means (1. 3) responsive to rotation amount data 
supplied in accordance with operation of an opera- 
tion member (22) as one of elements defining the 
skeletons, for calculating the display position of a 
model associated with each skeleton on a two- 
dimensional display screen, characterized in that a 



constituent portion comprises one or a specified 
number of models (M) is deformabie, and that each 
skeleton conresponding to the constituent portion 
are stored in said storage means (30) in a mutually 
5 related manner thereby rendering the rotational 
amount data for movement of a con'esponding 
model readable in a timebase direction. 

3. The apparatus as recited in claim 2, characterized 
10 in that the constituent portion (40) has a cubic like 
shape and wherein those skeletons Included In 
such cubic portion are certain number of ones as 
provided defining an umbrella in shape. 

IS 4. The apparatus as recited in claim 3. characterized 
in that the cubic portion (40) has therein a plurality 
of vertically coupled auxiliary skeletons (SK21. 
SK22. SK23) not relating to polygons, and that the 
umbrella-like skeletons (SK11-SK14. SK31-SK34, 

20 SK41-SK44) are provided and elongated from at 
least two locations of an endpoint of auxiliary skele- 
ton thereby defining an umbrella shape. 

5. The apparatus as recited in claim 2, characterized 
25 in that the constituent portion is an image compo- 
nent representative of long hair (71) on part of a 
character object (70) being displayed with a plural- 
ity of skeletons (SK71 -SK75) being serially coupled 
together covering from a root up to a tip of hair. 

30 

6. The apparatus as recited in claim 2. characterized 
in that the constituent portion is an image compo- 
nent indicative of a pair of mammary glarKis on a 
chest of a character object (80) resembling a 

35 human t)Ody while causing each of the skeletons 
corresponding to the constituent portion to be cou- 
pled to each endpoint of two skeletons disposed in 
parallel from the same position. 

40 7. The apparatus as recited in claim 2, characterized 
in that the constituent portion is an image compo- 
nent representative of upper and lower eyelids (63. 
64) of a character olDject (60) while causing respec- 
tive skeletons corresponding to the constituent por- 

45 tion to be disposed in parallel so that these 
correspond from the same position to the upper and 
lower eyelkis (63. 64) respectively. 

8. A method for generating a skeleton-based dynamic 
50 picture image by sequentially fetching data of skel- 
etons (SK) coupled together in a predefined order 
and then calculating based on resultant data the 
display position of a model (M) associated with 
each skeleton on a two-dimensional display screen, 
55 characterized in that said method comprises the 
steps of placing an auxiliary skeleton (SK21-SK23, 
SK31, SK50, SK62, SK70. SK80-82) with no rele- 
vancy to nrxxJels at a specific position on an imme- 
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diate upstream side of a lowest stream of skeleton, 
and successively perbrming fetch or acquisition of 
data of the lowest stream of skeleton after comple- 
tion of fetching of the auxiliary skeleton. 

5 

9. A method for generating a skeleton^sased dynamic 
picture Image comprising the steps of providing one 
or more skeletons (SK) for use in defining relative 
positional attitude of polygon serving as display ele- 
ments of a character object, causing each skeleton io 
to be associated with a model (M) essentially con- 
sisting of an ensemble of a predefined numt)er of 
polygons, and calculating based on rotational 
amount data given in response to an operation as 
one element fa definition of the skeleton the dis- 75 
play position of a model associated with each skel- 
eton on a two-dimensional display screen, 
characterized in that said method further com- 
prises the steps of defining as part of the character 
object (40. 60, 70, 80) a deformable constituent 20 
portion configured of one or a plurality of models, 
adding timebase rotational amount data to each of 
the skeletons (SK) corresponding to the constituent 
portion, and effectuating deformation with corre- 
sponding models (M) being associated with each 2S 
other. 



tured from one or a specified number of models 
(M). adding timebase rotation amount data to each 
of those skeletons (SK) corresponding to the con- 
stituent portion, and allowing corresponding mod- 
els (M) to exhibit mutually related motions. 



10. A medium storing therein a program for generating 
a skeleton-based dynamic picture image kiy 
sequentially fetching data of skeletons (SK) cou- 30 
pled together in a specified order of sequence and 
then calculating tiie display position of a model (M) 
associated witii each skeleton on a two-dimen- 
sional display screen, characterized in that an aux- 
iliary skeleton (SK21-SK23, SK31. SK50. SK62. 3S 
SK70, SK80-82) with not relating to models (M) is 
placed at certain location in the immediate 
upstream of a lowest stream of skeleton while caus- 
ing fetch of data of tiie lowest stream of skeleton to 
be performed in a way successive to fetching of the 40 
auxiliary skeleton data 



11. A medium storing therein a program for generation 
of a skeleton-based dynamic picture image by pro- 
viding one or several skeletons (SK) for use in 45 
defining relative positional attitude of polygons act- 
ing as display elements of a character object (40, 
60, 70, 80), causing each said skeleton (SK) to be 
associated witii a model (M) essentially consisting 
of an ensemble of predefined number of polygons, so 
and calculating based on rotational mount data 
given in response to an operation as one of ele- 
ments defining tiie skeletons (SK) tiie display posi- 
tion of a model (M) associated with each skeleton 
on a two-dimensional display saeen. character- ss 
[zed in tiiat the program further comprises the 
steps of defining as part of the character object (40, 
60, 70. 80) a deformable constituent portion sti-uc- 
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